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ABSTRACT 

Existing data are reviewed and synthesized that speak 
to the extent to which Consumer and Homemaking Education (C&KE) 
programs at secondary and postsecondary levels contribute to student 
knowledge, attitudes, and behavior. DifferenceiS in program design 
that were found in the research literature are described before 
findings about effectiveness of CS|HE programs are reported. These 
findings are grouped according to their impact on learner *s ^ 
knowledge, learner *s attitudes, student perceptions of usefulness of 
CttHE courses, .and impact on learner*s behavior. Findings are reported 
that suggest that CfcHE programs are effective, although many of the 
studies cited tended not to be widi'.ly general izable. The second part 
of this report discusses research oesigs for better effectiveness 
evaluation. Some alternatives to traditional experimental research 
designs are reviewed, including naturalistic inquiry, modus operandi, 
goal*-free evaluation, regression discontinuity'analysis, and goal 
attainment scaling. These other suggestions for sound research 
designs are ^discussed; avoidance of errors and limitations, 
ests'/blishment of test instrument/evaluation measure reliability and 
validity, and planning for ^replication. To illustrate appropriate and 
inappropriate methodology and assumptions. Mental Health, Head Start, 
and Employment and Training Programs evaluation research studies are 
summarized. Some researth in progress is aliso described. A 
bibliography is appended. (7LB). 
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"PREFACE 

The Education Amendments of 1976 (PL 94-482) charged the National 
Institute of Education (NIE) with the responsibility for undertaking "a 
thorpugh evaluation and study of vocational education programs^ including 
such programs conducted by the states and such programs conducted 
under the Vocational Education Act of 1963..." The mandate specifically 
stated that the study shall include a review of evaluation of the effective- 
ness of programs funded under the Consumer and Homemaking fCducation 
(C&HE) provisions of law. 

Three major activities were initiated .relative to this mandate. First 
the NIE commissioned leaders in C&HE to prepare a series of position 
papers. These papers served to provide perspectives for conceptualizing s 
framework for the study of C&HE programs. Three of the position papers 
were published in The Planning Papers in Consumer and Homemaking Edu- "^ 
cation Programs , Vocational Education Study, Publication No, 2, April 
1979. • ' 

Second, a study was designed to determine who has been served by 
C&HE (i.e.'/ how many students were enrolled and in what programs; and, 
to the ^extent possible, effort would be make to identify the content of the 
courses offered). This study was called the Responsiveness Study . 

Third, a study was designed to determin,e the impact of C&HE pro- 
grams on learners. The design for this study called for the review and 
synthesis of existing . data that spoke to 'the extent to which C&HE pro- 
grams contributed to student knowledge, attitudes, and behavior in the 
C&HE content areas identified in the legislation. 

12 



OVERVIEW OF CONSUMER AND HOMEWIAKING EDUCATION ' 

HIstoK^ . • 

Consumer and Homemaltlng Education Is an"" outgrowth of the home 
economics movement champlon,4d by Ellen H. Richards in the latter paFt of 
the nineteenth century and/ the early part of -the twentieth century. The 
major thrust of the early jiome econorpics movement was to campaign for 
safe and sanitary water and food supplies for human beings, to address 
the survival skills, and the qther needs of individuals and families. 
Purpose of C&HE " 

The major purpose of federrally supporjted programs of Consumer and 
Homemaking Education today is identified in the Vocational Education Act of 
'1963 and the Vocational Amendments of 1976 which' specify that Consumer 
and Homemaking funds may be used for six program areas: 

Consumer education 

•Food and nutrition / 
.^Family living and parenthood education 

ChildtWevelopment and guidance 
' Housing ^nd Home ma^iagement 

Clothing and textiles 

These purposes are an expansion of the objectives of the original movement 

1 . o - 

'but encompass the original objectives of home economics. 

Home' Economics was one of the vocational programs given impetus by 

the funding of the Smith-Hughes Act of 1917. The Smith-Hughes Act had 



as a, major purpose to provide education of less than tCollege graduates 



in 
e- 



Agriculture, Industrial Education and Home Economics. A series of sub^ 
quent acts (George-Reed Act of 1929, George- Ellezy Act of 1934, George- 
Dean Act of 1935, - Geoge Barden Act of 1946, Vocational Act of 1963, 
Vocational Amendments 'of 1968, and the Vocational Amendments of 1976) 
have conti; ued. to provide funding for Home Economics, later called Con- 



sumer and" Hotfie.-naklng 'Education -(C&HE) programs. The continuous 
funding of the C&HE pTograms since ®1917 acknowledges the recognition by 
the Congress' of this program. ' ' * ■ * ' ' 

With the Vocational Education Act of 1963, a p^yision was established 
to encourage states to develop occupational hom4 economics- related pro- 
grams. This was accomplished, by authorizi/g the distribution of. 15 
' percent of eacfv state's C&HE* monies for occupational home economics pro- 
grams. This stipulation implied that the Congress recogmzed the need for 
workers trained in home economics related occupations, as well as the need 
to prepare people for their roles as consumers' and hom'^makers. 

• The Vocational Edufcation Act of 1963^*vas amended in 1968 and 1976. ^ 
The amendments provided grants to states for the purpose of assisting 
them in conducting C&HE programs. The 1976 amendments stat« that, the 
grants under subpart 5, Section 150 are to be used in part "for educa- 
tional programs, services, and activities at . all educational levels for the 
occupations of homemaking. ^ ' ^ 

States have some discretion over their C&HE programs in order to 
meet the needs of the people in their state: T-Ke program is presented in 
the State Plan for Vocational Education; when the State Plan is accepted, 
the state may offer their proposed program. Therefore, whilfe the basic 
thrust of the C&HE program is similar from' state to state, some elements of 
the C&HE program are unique to each state. Conditions for profPam 
flexibility are inherent in the legislation. The opportunity to develop 
programs that meet the unique needs ^of -a state may well be one. of the 
strongest aspects of the C&HE programs, and simultaneously, the aspect 
that makes a. rigorous national effectiveness evaluation study difficult, if 
not impossible. ^ j' ' • • 

• - / 
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PART I 

Consumer and Homemaking Education 
Effectiveness Study 

Introduction ^ • ' 

The primary purpose of this paper is to provide information on the 
effectiveness of Cnsumer and Homemaking Education Programs at the sec- 
ondary and post secondary levels. To achieve this purpose the authors 
reviewed available literature for information about the relationship between 
instruction *ln Consumer and Homemaking Education programs and changes 
in learners' knowledge, attitude, and behavior. ' 

This C&HE Effectiveness study report is based oh extant data that 
were available to the authors in the form of research studies and/or re- 
ports. Much of the research reported In this paper is evaluation re- 
search. "Evaluation research is concerned with finding out how well action 
programs work" (Weiss, 1972, p. 3-4). 

The criteria used for selecting studies and/or reports were that they 
assessed the knowledge, attitudes, and/or behaviors achieved by learners' 
of (1) one or more of the content areas of consumer and homemaking 
programs, (2) populations that Include handicapped, disadvantaged, and/or 
regular students, (3) secondary, post secondary, or adult level students, 
and (4) the study was undertaken and completed In the past ten years. 
These were to be studies of C&HE programs that were fully or partially 
supported .with federal C&HE funds or programs that had vocational ap- 
proval in states that supported only exemplary programs. 

An extensive search was conducted to determine the existing effec- 
tiveness research. This Included a search of ERIC and DATRIX and an 



extensive mall solicitation. Lettrs were s^nt to State" Supervisors of Voca- 
tional Consumer and Homemaking Education In the fifty states and to units 
(colleges, schools, or departments) of Home Economics that have graduate 
programs (at least at the Master's level) requesting that information about 
or copies of all existing evaluation studies and/or reports of an effective- 
ness nature be forwarded to a central location for review by the consul- 
tants* Copies of the letters to state supervisors and teacher educators of 
C&HE are included in Appendix A. Further requests for help in identify- 
,ing studies we^e made at four national, meetings attended by state super- 
visors, teacher educators, and researchers. These include AVA, 1979; 
AHEA, 1979, 1980; and, the U.S* Department of Education, sponsored Home 
Economics Education Conference, 1980. \ 

The persons who responded 'sent masses of materials; however, care-^' 
ful review of these materials revealed that very little research that^speaks. 
to the efTcCtiveness of C&HE programs has bejen conducted/ Persons who . 
re^ed to the' requests identified eighty-two (82) studies, reports and/or 
developmental projects. All of them were reviewed and forty-six (46) ape 
cited in th is report. 

Researchers have conducted both formal and informal evaluations of 
Consumer and Homemaking Programs. Formal evaluation studies are char-- 
acterized by their utilization of questionnaires, structured observations, 
controlled comparisons, and standardized testing of students. Informal 
evaluations are Characterized by their use of casual observation, implicit 
goals, intuitive norms, and subjective judgment (Stake, 11972) t 

» ' *« ' ' ' 

In this report, conclusions ^about the effectiveness bf Consumer and 
Homemaking Programs will be drawn from studies with learner outcomes as 
a research variable. Some of the findings cited in this report may Be 



generallzable to other C&HE programs; however, the design utilized, in 
many of the studies renders the findings applicable only to *the particular 
learners who Were studied. 

Consumer and Homemaking Program Descriptions ' 

The Education Amendments of 1976 specify "^that Consumer and .Home-. 

making Education funds may be used for six ^<^gram areas: 

Consumer education 
Food and nutrition ^ 
Family livipg and parenthood education 
Child' development and' guidance 
Housing and home management 
Clothing and textiles 

Educators were directed to design- C&HE programs to encourage par- 

ticipation of both males and females in prep'aring for a combination of roles 

for homemakers and wage earners. Also, the content of the programs was 

to reflect current societal ^^e'eds. 

The phrase "C&HE Programs" conveys to some the image of one basic 

instructional program that is* duplicated in local education agencies across 

'the fifty states. .This is certainly a misconception. The programs are 
reportedly ' designed to meet the needs o*f the learners; therfore; each one 

-:tends_tP_liave s^^^upjjjgjMfeatgj::^ . Conditions for progran) flej^blll^^^ 
Inherent in the legislation. Programs differ according to the following: 
(1) empha^ placed on the six-program areas;^(2) the age, background; 
gsbgraphic location, ability, interest, aptitude, and grade level of the 
learners'; .(3) the amount of financial, community, educational resources 
and facilities available; and (4) the way in which the schools are organized 
(e.g., elective or required courses, length of class periods, frequency of 
class meeting, and the number and types of C&HE courses offered). For 
example. Sand (1980) found that the program offered in the school that 
students attended in Iowa was related to both their< knowledge and atti- 
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tudes toward parenting. The philosophical* orientation of program planners. 
Is reflected In C&HE programs. 

Many states have Identified extensive lists of objectives and/or com- 
petencies to be achieved through th^se programs. The V-TECS task lists., 
which were developed by the Vocational Technical Consortium of States, Is 
ai? example. Such lists generally reflect the knowledge, skills, and affec- 
tive orientation needed to perform effectively In consumer ^nd hbmemaking 
roles. Monts and Barkley (1978) conducted a stateiwide study in Arizona - 
to identify empirically the essential living skills perceived as important by 
men and women in their Voles as family members, : individuals, and em- 
ployees. The researchers noted that the^,skills identified in their study 
provide a sound ba^is«for program development. Abt et , (1978). iden- 
tified .and analyzed the^ tasks performed lay homemakers in Colorado. 
These can also be used as a basis for program development. Such data 
are available or being collected for many states anc| can a\so be u^d as 
bases for formulating— evaluation research Instruments. - The following 
information provides some insight into the nature of C&HE programs' in 
several states. " 

Irvine (l57b; surveyed home economics teachers in Utah to determihe' 

the status of consumer education in that state. She conchuded* that c6n- 

sumer education was an Integral part of the hometnaking curriculum in 

Utah. Teachers reported that consumer education was four times-' mor6 

likley to be integrated throughout the C&HE curriculum than^to- be taughit 

as a separate course. The consumer ed'ucation content .taught most fre-* 

' •% * - - * * 

quently was in this order: 

Purchaser of food and clothing , \* 
Consumer decision making , ' . \ 

Consumer information y 
Financial management 

18 . .r ' 



Irvine found that more instructional time was devoted to the teaching of* 
coi^mer education at the high school than the junior high level. Fults 
■ (1979r~"and Irvine reported that students and former students belieVe 
consumer content related to family financial decision making is more rele- 

K 

vant to high school than junior high students. * 

Uhl (1970) found In a national survey that 97 . percent- of " the 280 
senior, and junior-senior high schools in his sample reported offering one 
»or more home economics courses that included....^sumer education content. 
These courses, he found, were 'based on content\:^ated to the consumer 
in the" marketplace and the consumption of food, clothing end soft goods. 

- A sample of home economics teachers *ln Florida indicated that their 
consumer education classes included content on budgeting, banking, 
credit, governmental agencies, guarantees -and warranties, home and 
apartment rental and ownership. Insurance, law, medicine, motor vehicles, 

^ professional services, savings, securities, and taxes. Even though empha- 
sis wds given .to 'all the domains of education in Florida, the teachers 
repbrted that- for CQjnsumer education, cognitive objectives were emphasized 
more* than affective or psychomotor (Cogle, 1977) » 

, Wllkosz (1972) studied secondary consumer homemaking programs In 
Minnesota to determine whether the instructional content was: consistent 
with the requirements established in the 1968 amendments; provided a state 
-required . general education component to foster creative thinking; and, 

delated 'to the needs, attitudes and problems of the students. Data were 
collected by^jmailed questionnaires " and through selected on-site observa- 
tlons, Tho findings revealed- that food and nutrition content received ,the^ 
greatest instructional emphasis. Child development and family relationships 
followed closely in emphasis. Content in child development focused on 

19 



human growth and development, and In family relationships general aspects 
of growth and development refated to personal and family life vyere the 
focus. The next areas of emphasis were consumer education (separate 
courses, not Integrated content in other courses), housing, and clothing 
and textiles. 

Waicis (1976) conducted a survey to determine how effective Part F, 
Section 150, and Subpart 5 funds have been in extending and improving 
consumer education in home economics consumer andlhomemaking programs* 
She also sought to determine the amount and orientalion of consumer 
education being taught in Pennsylvania schools. Thti data provided by 
home economics teachers revealed that both programs tended to infuse 
consumer education topics and content into evecy area of home economics. 
She also found that funded programs tended to have a separate course in 
consumer education and non-funded programs did not; 

•Waicis found, there was no difference in the orientation of course 
objectives between the 9th- and/or 10th grade; however, there was a sig- 
nificant ^dfference betvieen the 11th and/or 12th grade. In the upper 
grades, the objectives of funded programs were higher* in both information- 
centered and process-centered orientation than the non-funded programs. 

, Although the Education Amendments of 1976 specify six program areas 
for C&HE, tbe amount of instructional time allocated to each of the areas' 
may vary from 'one school district to another. In some states and be fairly 
consistent across districts In others. Otto (1979) found that In Nevada, 
the percent of time spent In the various subject areas In high schools was 
Js- follows , ' . 

Clothing and textiles 29% 

Food and nutrition 27% 
General comprehensive home economics which includes 

all subject areas 15% 
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Child development and family living 11% 

HtRO and various work oriented units 10% 

Housing and home furnishing 6% 

Consumer and family economics 2% 

In the junior high schools, Otto found the percent of time allocations: 

General home economics 45% 

Food and nutrition 27% 

Clothing and textiles ^ 20% 

Housing and home furnishings 3% 

Child development and family living 1% 

And others ^ 4% 

The enrollment in the classes by sex at the senior high level was 85% 

female and 15% male. In the junior high schools in Nevada, there were 

« 

almost equal numbers of males and females in grade 6, and about half as 
many males as females in grade 8. Overall in the junior high schools, 29% 

m 

of the enrollment was male and 71% was female. 

Some C&HE programs are designed specifically for adults, Arizona, 
Illinois,' Ohio, Washington,* New York, and Wisconsin were reported to have 
extensive* networks of Consumer and Homemaking Programs fur adults* For 
example, it was reported that the State of Wisconsin offered instruction 
through sixteen Vocational, Technical .and Adult Education Districts to help 
meet the -consumer and homemaking education needs of disadvantaged 
adults with low to marginal incomes in rural and urban areas/ Instruction 
was being offered in consumer education, parenting, family living, home 
management, nutrition education, personal development, clothing, and 
housing. . . ' 

Consumer and Homemaking Education activities in the State of Wjsh- 
ington have been . coordinated through the State Board for Community . 
College Education- .In 1976-77, projects included senior citizen programs, 
parent education, programs, consumer and homemaking programs, and 
courses for handicapped homemakers* 
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In 1979; the State of New York had thirty-one C&HE programs for 
adults^ A major objective for ^hese programs was to hqlp people in eco- 
nomically depressed areas improve their consumer and homemaking skills* 
The programs were offered in comm.unity settings and the^e were some 
outreach C&HE programs in county jails, half-w?y houses, and day care 
centers for handicapped adults./ 

In fiscal year 1978, 1,044,108 student hours were ^pent in' the adult 
programs in New .York. Unduplicated enrollment figures showed 18,859 
maleC/ 64,589 females and 4,684 children participated in if^te programs. 
The greatest number of student hours were spent in home management and 
consumer education (209,718 student hours), followed by food and nutri- 
tion (168,867 student hours), family relafionships and child development 
(152,092 student hours), and home furnishings (104,627 student hours). 
The enrollment in the programs in New York- had increased over ,the years/ 

The Cooperative Extension Service netwoi k is used to provide con* 
sumer and homemaking content to low income adults in Illinois and several 
other states. The 1978-79 Annual Report of . this program in Illinois 
-showed that 13,309 persons had participated Fn the program. Though 
actual data were not supplied, the report indicated that the participants 
had achieved the program objective of improved management of money, 
time, and other resources. 

Many C&HE programs are being offered to high school age students in 

non-school settings. Such programs are generally designed to meet a 

particular need of persons with multiple personal problems. Tennison 

(1978) reported that home economics programs in the Kansas City, Missouri 

l^chool District have had a major impact toward meeting the needs of some 

♦ 

urban youth. For example, it was reported that Missouri had C&HE out- 
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reach programs in a Juvenile* Detention Center and in a Center for School 
Age Parents • The program in the Juvfcnile, Detention Center focused on 
the development of personal living skills and the enhancement of students' 
self concepts. The Center for School Age Parents provided instruction in 
parenting; consumer education, and family relations. These programs 
attempted to provide instruction to young people ^ith special needs, 

-Programming tc meet the needs of special student populations, disad- 
vantaged, physically and mentally handicapped, and socially maladjusted, 
has long been emphasized in C&HE, This charge was also stated in the 
1976 amendments. 

Quantitative and Qualitative Meast/res of Effectiveness 
Research findings^ about the effectiveness of C&H ^programs will be 

reported according to the impact on the learners' knowledge, attitude, and 

Behavior, Some studies will overlap into at least two of t'he categories and 
. will be mentioned in each section of the report. 

Impact on Knowledge 

White (1980) measured student achievement in a pilot (C&y^ course. 

Thfe course. Adult Roles and Functions (ARF) was taught in high schools 

throughout the state of West Virginia in 1978-79, 

She used a one group pretest-posttest design. The research irtstru- ^ 

ment consisted of 100 items. Ninety-three items were based on the compe-. 
Jiencies spiscified in the currir.ulum. It had a reliability coefficient of .913 

according to the Kuder-Richardso.i 20 formula, a reliability coefficient of 

,896 according to the Kuder-Richardson 21 formula, and a difficulty level 

of 59 percent. 

Data were collected from 353 students throughout the state. Sixty- 
five percent of the subjects were female and 35 percent were male; about 
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95 percent were juniors and seniors; 78 percent were 17 or 18 years of 

age; and 90 percent reported that their grade point average was 2,5 (the 

author did -not report the GPA scale) or above. 

The subjects' achievement scores were determined by calculating the 

difference between the pretest and posttest means. A t statistic was used 

to determine the level of significance. The achievennent scores on the total 

instrument were significant at the ,001 level. The instrument consisted of 

Items related to the following eight subsfections of course content: 

Introduction 
Family "relations 
Parenting 

Housing , 

Nutrition 

Careers 

Consumer education 
Home management 

The students* achievement scores on each of the subsections were signifi- 

cant at the .0001 level. , The analysis revealed tnat grade point average 

and previous home economics experience had little effect on the level of 

achievement of students enrolled in the ARF courses. 

Miksis (1978), Hutchlns (1970), and Harrison (1970) used the same 

instruments to collect data in three separate studies relative to the impact 

of C&HE knowledge on students* self concept, marital role expectation, and 

understanding of behaviors of children and behaviors of Tamily members. 

Their data consisted of scores on Leary*s Interpersonal Checklist, a 

measure of self concept; -the Dunn Marital Role Expectation Inventory 

(DMRElJ, a measure of marital role expectancy in seven areas: 

Authority 
* Homemaking 

Child care 

Personal characteristics 
Social participation 
Education 

Employment and support 
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The Film Test for Understanding Behavior (FUB) is a measure of behav- 

i 

loral understanding. The FUB has three subscales: / 

Knowledge 

Guidance 

Sensitivity 

The subjects in these three studies w€re enrolled in high school' C&HE 
classeS|^ Hutchins used a control group that was also an intact group. 

Miksis (1978) studied students' understanding of children's behavior 
and students perceptions of their marriage role expectations, self concept 
and ideal marriage partners. A total of 57 sophomore, ^junior, and senior 
high students participated in the study. They were al! enrolled in a 
course in. child development that was to be taught for a full academic year. 

* 

The subjects constituted three treatment groups: 

Group I ' (N = 28) had completed one term ' 
Group II " (N = 16) had completed two terms 
Group ill (N = 13) had completed three terms 

The child development class consisted of three types -of student; In- 
volvement, They were involved in (1) formal study in the classroom, (2) 
regularly scheduled observations of children with some opportunity to 
practice interpi:eting the observed behavior of children, and (3) making 

r 

practical application of theory and guidance principles within a preschool 
laboratory. 

All the students had significant (j||^) increases in the total posttest 
scores on understanding the behavior of young children. The scores on 
the sensitivity subscale of the FUB were significant at the .01 level. The 
jstude^Tts in Group II had the greatest change in scores, fallowed by Group 
I and then Group III. Group III had the highest pretest scores. 

Although the following findings were not significant, the pretest and 
posttest data showed that student^ perceived themselves to be more loving,- 
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their ideal mates to be less dominant, ano their marital roles, more egali- 
tarian. 

Hutchins (1970) used experimental and control groups to assess 

whether change occurred In high school students' self concept, marital role 

expectations, and behavioral understanding after taking a course in family . 

life education. Data were collected from 106 male and female, 11th and 

12th grade students: The fifty-three persons in the experimental group- 

and the fifty-three persons in the control group were matched according to 

age, sex, socioeconomic status, and grade point level. Hutchirts reported 

^ . that the experimental group experienced a significant change at the .05 

level in marriage role expectations. They became less authoritarian and 

more egalitarian*. The mal^s. in the expeVimental group had significant 

achievement (.05) in their understanding' of principles on the guidance 

subscale. There was no significant change in student sehf concept as a' 

result of participating in the course- 

The study by Harrison (1970) was designed to assess changes in 

, eighteen 10th, 11th, and 12th grade students during their enrollment in a , 

high school child development course. The course involved classrobm 

study of normal growth and development patterns of young> children and 
« 

participation in a child observation center. There were significant in- 
creases of mean scores on the FUB which "was used to measure under- 
standing of children's behavior. The subjects showed an increase in their 
understanding of the behavior of preschool children at the .05 level of 
significance. The subjects* marital role expectations became more egali- 
tarian, though the change was not ^statistically significant. Ther;e were no 
significant changes in- self concept as an outcome of the course. 
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Mumme (1974) conducted a study , to determine whether the use of 
special teaching materials affected high school students' achievement. 
Mumme used an "Innovative" strategy that consisted of a variety of action 
oriented activities and learning resources for a six week unit In child 
deve|opmef|it. The" achievement of 38 students who received the Innovative 
instruction was 'compared with that of a control group of homemaking 
students who were not' taught via these materials. An analysis of pretest 
and posttest scores* showed that the experimental group had a gain in 
cognitive achievement that was significant at the .001 level. Mumme, who 
vyas the teacher for the experimental group, reported observed behavior of 
the students that was Indicative of increased interest. For example, 
Mumme noted that students requested that they continue their study of 
young children after the allocated six week' period and that some students 
vo^unteerec^ £o- work with children ojutside the class. 

Holt (1977) conducted a study to determine if commercially prepared 
units of* teaching materials in child care would produce higher gains in- 
student achievement than teacher ' prepared materials* The study used 

treatment, posttest, and .follow-up design with three groups of home eco- 

' * \ 
nomrcs teachers. One group was provided commercial materials and trained 

for three days to use them. Another group attended' a three day work- 
shop and prepared materials specifically for their teadhing situations. The 
■third group was not given any training or materials. These teadhers were 
asked to. use their normal methods and materials. Achievement of the 

students of the three teachers was' assessed immediately after instruction 
V . 

and again one year later. The data indicated that students of teachers 
who ^prepared materials specifically 'for their situations 'evidenced. greater 
immediate and long-term achievement than • students of teachers in the other 
two groups. 



Shaw (1972) conducted a study to determine whether or not /students' 
perceptions 'Of their understanding of concepts in home and^ family living 
changed after receiving instruction on those concepts, A 115 item Likert 
type instrument which asked students to indicate the extent of their per- 
ceived understanding of the concepts Mn a home and .family living course 
was administered tp 64 junior and senfor High, school students in Texas 
prior to and after instruction. The instrument yielded an overall score 
and scores on four subscales: dating, marriage, parenthood, and families. 

The difference between the pretest and posttest overall mean scores 
•was not significant. However, the mean posttest scores on two subscalef 
were significantly greater than the pretest scores.. The subscale score on 
dating was greater at the 0.5 level and the score on understanding of self 
and families was greater at the .01 level of significance. 

Consumer and Homemaking Education Programs in Iowa are being 
evaluated by persons in the Department of Home Economics at Iowa State 
University in cooperation with the Iowa Department of Public Instruction. 
This effort started in the fall of 1977., Three of the studies which focus 
on* the' impact of C&HE programs on students and former students are 
j'ncluded in this report. 

These* studies are by Sand (1980), Crawford (1980), McClelland 
(1980), and Harder (1979). Harder ana Crawford evaluated, consumer edu- 
cation courses. McClelland and Sand evaluated parent education courses. 
'These researchers encountered some difficulty in identifying students for 
control groups who had^ no instruction in the areas , they were stud^ng. 
Many of the persons in the control groups had jnstructlon in C&HE courses 
in junior high school and/or 4-H Clubs eveii though they were not enrolled 
in the courses ^being studied. 

- ' 28 . ' 
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» Crawford (1980) assessed the Impact of Instruction In consumer edu- 
cation on a sample of 87 high school seniors who had been enrolled in 
•three or more semesters of homemaking classes. The control group'' con - 
sisted of 64 students who had not studied C&HE In high school. The two 
groups of students were comparable In socioeconomic status .and grade 
point average. The research Instruments \^er^ based on the Iowa Guide 
for. Teaching Management and Consumer Education. 

A Consumer Education Inventory (CEI) which was designed to collect 
data on student background, knowledge, attitude, and intent was 'admin- 
istered to all subjects by their classroom teachers In May, 1979. Tbe'^ 
Consumer Education Interview Schedule (CEIS) which ^ was designed to 
determine the students' consumer^sponsibillty and practice after gradU- 
atibn and their perceptions of and recommendations for program outcomes* 
' was .administered to 80 former homemaking and 47 non-homemaking stu- 
cJents. ' . 

The analysis of data revealed no difference in the consumer education 
knowledge of the two groups.. Almost all of the students (93%) recom- 
mended the use of homemaking courses to - teach high school students 
consumer education. The two areas where Instruction vas most frequently 
recomm^Ddad were planning/budgeting for spending money and comparison" 
shopping. Homemaking studentsjndicated that consumer education courses 
had contributed to increased self awareness. Increased management skills, 
and clarlflcation/d(Bvelopment of personal values. 

Harder (1980) collected data from 109 high 'school students In Iowa on 
the effectiveness of consumer education courses in hetping students 
achieve specific comp§tencies. She developed and collected data via two 
instruments that were based on the content areas in theJpwa Guide for 

% 
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Teaching Management and Consumer Education. Using t'he Kuder-Richard- 

son Formula 20, the research instruments. Form A -and Form B,,hadWti* 

» % 
mated reliability scores of and .85 respectively.' ' ^ . 

In the schools, studied, consumer education content was taught* in 
home, economics/ economics, business, and social studies courses. Harder 
found significant (.05) correlations between scores on both tests^and 
enrollment in child development and business educatFon. Significant (.o's) 
correlations existed between enrollment in business education, child devel- ^ 
opment, clothing and textiles, and foods and nutrition, and scores on test. 
Form A. On test Form B, significant correlations existed betvHieeh t4st * 
scores and enrollment in business education, comprehensive, hortie economics 
courses, and £hild development.. ' ."^ # 

McClelland (1980) assessed the impact of parenthood education courses 
on a sample of 15 former C&HE students. The control group was* composed 
of 11 former student^ who had not received instruction in parenthood edu- 
cation. Each subject had baby 12 to 24 months of age. . 

The instruments 'used to collect data in this study were the Rating 
Scale for Parenting- Behavior (RSPB), the Parent Behaviors Interview 
(PBI) and- the Iowa P^arent Behavior Inventory (ItPBI). The RS^B was 
designed to assess the parent's management jDf tfte child's physical envi.- 
ronment and parent's interaction with the. child. it has -an estij(»ated 
inter-rater reliability of .70 and an estimated intra-rater reliability range 
of .83 to .98. The PBI was a semi-structured interview schedule whid^ 
focused on the parent's behaviors, and the reasons given for them. The 
IPBI instructed parents to indicate the degree to whiph behavior state- ^ 
ments were typical of themselves, 'it, had a reliabilty "estimate for the six 
factors on the inventory .of .56 to .81. 
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McClelland found that on the RSP6, both groups Had mean scores 'at 
^'or above the level judged adequate for parenting. On the PBI/the former 
students' had three mean scores that were below the level/judged adequate 
, in this study for parenting, and the control group had seven mean scores 
•^b.elpw the adequate level. 

Sand (1980) develop^ and administered a Parenthood Test to 455 
students who were enrolled In 10 different high schools in Iowa. The 
Parenthood test consisted of a knowledge section which had 'an estimated' 
reliability of -.84 using the Kuder-Richardson Formula 20 an., an attitudinal 
section. 

The e;cperimental group in this study, consisted of 268 students who 
had taken a semester course in child development. The comparison group 
consisted of 187 who vyere enrolled in other C&HE courses. 
; . ^\Data were analyzed to determine the effect of the following variables 
on students' parenting knowledge and attitudes: 

Sex 

Grade level 
School 

Child development enrollment 
Previous home economics classes 
Personal parenting plans ' 
Amount of experience with children 
Type of experience with children 

Sand found significant differences In the knowledge scores between 

males and females, between grade levels, between schools, and between 

Students who had taken a comprehensive home economics course and those 

who had not. 

Lee (1972) emphaisized the need for future homemakers to understand 
and be able to use metric measurements. She conducted a study to^deter- 
mine the effectiveness of teaching metrics in a comprehensive vocational 
home economics classroom through practical application in laboratory situa- 



4. 



o 

ERIC 



4 



> 31 



tions. The sample. for this study consisted of twenty-eight high school 
juniors and seniors. Fourteen of the subjects were enrolled in the home 
economics program and formed the experimental group. Fourteen were rtot 
and were In the control group. 

The home economics students acquired more knowledge about metric 
measurements than the control group. This finding was significant at the 
.005 level. There was no differences in the attitudes of the two groups of 
students .toward the use of metric systems. The students in the experi- 
mental group were confident of their knowledge of th^ metric system. ' 
They also indicated a significantly, higher level of confidence (.05) in their 
answers on the metric Vnowledge test. 

The following three studies conducted by Spitze (1976), Davis (1974), 
and. Schwartz (1973) measured the nutrition knowledge of high school 
students and high school graduates. The findings in the Spitze-and Davi^ 
studies differ- from the Schwartz study. • • ^ 

Spitze (1976) assessed the nutrition knowledge of 50 high scTiool stu- 
dents in three intact classes who had -studied nutrition for 8-10 class ses- 
sions via discovery learning^ -techniques. Pretest and' posttest data were 
collected to determine cognitive and affective change in the learners. 
Cognitive data were collected with a nutrition knowledge test developed by 
Spitze. The reliability of the nutrition-, knowledge test, as' measured by 
the^ Kuder- Richardson Formula 20, was -.88. It contained 311 true-false 
type items . , , ' . ^ 

The difference betvyeen mean pretest and posttest scores on the 
nutrition knowledge test for the three classes was significant at the .501 
leveL • The lowest mean score difference was reported for the one class 
• that only met for 8 class sessions. There was no reported indication that 
ability levels of these students differed from the other subjects. , . 
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Davis (1974) compared the nutrition knowledge of ninety-four 9th 
grade students enrolled in home economics wtth non-home economics stu- 
dents • She found that the, home economics students had more knowledge 
of nutrition than fhe non-home economics students. Spitze's and Davis' 

i 

findings were not supported by Schwartz's (1973). 



Schwartz (1973) conducted a .study to determine the relationship 
between- previous enrollmeht In home economics courses and present nutri- 
tion 'knowledge, attitude, and practices of high school graduates.. Com- 
parisons were made befy/een gra^duates who were enrolled in courses with 
units in food, nutrition, and health,. and those who were not enrolled in 
such courses. 

Nutrition knowledge was measured by responses to' a ^30 item ques- 
tionnaire. The questionnaire was mailed t© 1,000 randomly selected 
graduates of 300 .randomly selected high schools Jn Ohio that had C&HE 
programs. Completed questionnaires were returned from 313 (31.3%) of the 
graduates. 

Schwartz found no relationship between nutrition knowledge and 
previous enrollment in home economics. She did find a significant rela- 
tionship, between nutrition knowledge and high cumulative grade point 
averages regardless of whether the former students had been enrolled in 
home economics. 

Schwartz had a relativbly low response rate. ' This may have biased 
her findings. She did not report how the non-respondents differed from 
the respondents. 

Stenner and Matsorr (1975) evaluated reimbu^ed Consumer and Home- 
making Education, programs in 128 school districts in Illinois. Illinois, at 
the time the study was conducted, funded only the C&HE, programs that 
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were offered to disadvantaged students. In order to receive reimburse- 
ment, the conditions In each of these school districts met at least one of 
the following* criteria: unemployment in excess of six percent; number "of 
persons receiving general assistance above 10 per-thousand; aid to depen- 
dent chlldren^of 60 or more per-tfiousand; or percent of family incomes 
below the national average of $5,400. 

Student achievement in Consumer and Homemaking Education' was 
assessed in fourteen areas: 
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Consumer in the marketplace 
Money management 
Consumer credit ' . v 

Housing. / . 

Food * " , , * V . 

Transportation ' * 

. . Clothing , , . , • . ■ 

. Health services . - * ^ ' * 

^ Recreation 

Furnishings and appliances ' * 

Insurance ^ \. 

"Savings and investments 
Taxes . . ^ ^ 

^ Consumer in society: * * ^ 

The Illinois Test of Consumer Knowledge (ITOCK), Forms A and B, with 

split half reliability scoreT^of !92 and -86 'respectively, were' used to 

collect achievement data. ■ The J4 areas listecl above w^re subtests within 

ITOCK. Stenner •and Matson reported that Form A contained test items 

that we^^ less difficult than Form, B. . ' 

• * , * ' 

i The achieO-emerit scores of students who had' taken Con&umer and- 

■ 0 r) 

Homemaking Education.- were compared with those of students with no in- 
struction in Consumer and Homemaking Education^ - ,0n Form A, the^ exper- 
imental students scored significantly higher', than control students on all- 
the subtests. The highest scores attained ^on Form A >vere irrthe areas of, 
consumer credit, housing, consumer in 'the marketplace, money manage- 
ment, food, and clothing. On Form 8/ the experimental students scored 
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significantly higher than the control students on the consumer In the 

marketplace, consumer credit, housing, and insurance subtest* 

Stenner and Matson found that student achievement in Consumer and 

1 

Hbmemaking Education was significantly higher in classes where the follow- 
ing forms of instruction were used: 

Resource Person 

Debates • . ^ 

Student demonstrations 

Multi-media 

Team teaching 

Field trips 

Cogle (1977) administered two 50 item tests to assess the effectiveness 
of consumer education programs in home economics in secondary schools in 
Florida. The two tests {Vest A and TesT B) were designed to measure 
student achievement. Test A had a Kuder-Richardson reliabilit|||poefficient 
of .937 for the experimental group and .907 for the control group. Test 
had a Kuder-Richardson reliability coefficient of .922 for the experi- 

mentaLgMup^_and ^IZ.J'or^the: controL_gmup_.l_Xest_ items„ were^based on 

the cognitive, affective and psychomotor learning objectives staled in the 
Florida Guide for Management and Family Economics. 
; The experimental group consisted of 457 students who had completed 
a -ourse in consumer education and the control gro^up of 1,110 students 
who were just beginning the course in consumer education. Cogle^s data 
showed thai students who had taken the semester course in consumer 
education obtained a higher mean score on the achievement tests than 
students who had not taken the course, however, this^ finding was not 
statistical ly-vsignificant* Cogle reported that some students in the control 
group bad taken home economics courses that may have included consumer 
information though not the semester consumer education courses. 

- \> 
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Sargent (1970) used programmed instructional units to teach consumer 
education content to high school students In a intact consumer education 
class and measured student achievement to determine if there were signifi- 
cant cognitive gains.. "The analysis of data from 25 students showed the 
difference between the mean scores of the pretest and posttest was sig- 

riificant at the •Ol level- Sargeh concluded that students' achievement was 

— — - — - - - J 

enhanced by the programmed instructional unit* 

Smith (1974) designed and used an illustrated instructional module to 
teach consumer education to educable, mentally retarded students- The 
module was written on a low reading level aqd contained many drawings 
that illustrated the content. Thirty-eight students were pretested, taught 
via the special module, and posttested after^ instruction had taken place. 
Data from students in the experimental group were compared to the pretest 

-and posttest scores" of u control group of students who had not used the 
modules in their instruction. Smith found that the experimental group had 

-greater-cognitive- achievement— than- the control-group. This finding was 
significant at the .01 level. ^ 

Kohlmapn et al. ,(1977) studied the achievement of 24 mentally and/or 
physically handicapped students in high school consumer, education classes 
in Iowa. The handicapped^ students had. been mainstreamed into regular 
classes that enrolled '*251 students. The students who were physically 
handicapped may have b'een ;of normal or .above normal intelligence.. There 
W.as no information reported on^their abilities. The pretest and posttest 
achievement scores of all 'the handicapped students were compared with the 
scores of the other students in the classes. The results indicated that* the 
mean achievement score of the 'handicapped students was near the class' 
average, | 
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• Nelson and Jacoby (1973) studied the achievement of 108 randomly 
selected participants In programs In New York funded 'unBer Part F, 
"Consumer and Homemaking Education of Title 1 of 1968 amendments to the 
Vocational Education Act-- These ^programs were designed to serve low 
Income adults and out of school youth by providing learning opportunities 
to meet the home economics related needs of individuals and families with 
special emphasis on consumer practices. Their findings showed that the 
participants* achievement of the program objectives, as reflected by the 
difference in their pretest and posttest scores, approached statistical 
significance. The greatest gains in knowledge were made in clothing and 
textiles, food and nutrition, and relationships of Individual and family. 
Impact on Attitudes 

The research reported in this section describes the relationship 
.between instruction of C&HE and students' feelings about self and/or their 
:feelings about C&HE programs. A few of the studies were cited in the 
knowledge, category also because the researchers studied both knowledge 
and attitudes of learners. 

Sand (1980) found that students who had taken a course in chffd 
development indicated higher mean attitude scores on parenting concepts, 
than a comparison group of students. 'She also found that the amount and 
type of experience that students had wi,h children made a significant 
difference :n their attitudes toward parenting. The more experience that 
students had/ the more capable they felt about dealing with children, 

Miksis (1978), Hutchins (1970), and 'Harrison (1970) all studied the 
relationship between C&HE content, self concept, and marital role expecta- 
tions. Miksis* data revealed that the students* self concept did not change 

after studying child development; however, they did see themselves as 

% 
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being more loving and sensitive to the needs of children. Hutchins found 
students who studied family life had significant changes in their feelings 
about marital roles. There was a decrease jn authoritarian role expecta- 
tions and an Increase In egalitarian role expectations. Harrison's findings 
were similar to MIksIs' and Hutchins'. 

Spltze used selected games and other techniques to teach nutrition to 
high school students. Data-^ere collected via a 20 item opionn&ire de- 
signed to measure students' attitudes about nutrition as a subject of 
study. Student responses showed a considerable positive shift In attitude 
on two items: - 

"I think Nutrition is an exciting subjept to study/' and "I think 
Nutrition is a duM ^subject", 

Greater numbers of student thought nutrition was exciting to study and 

fewer thought r|utrition was a dull subject* There was no difference on 

the other Items. \ 

Schwartz collected data about affiliates toward food 'and nutrition from 

♦ 

high school graduates. Persons who had been enrolled in home economics 
had significantly higher positive mean scores on a 30 item test of nutrition 
attitudes than graduates who had not been enrolled in home economics. 

Cross' et al. (1971) studied the relationship between the effectiveness 
of fulhtime homema,kerS; homemakers who were full-time employees, and^^the 
extent of enrollment in home economics at the secondary level. The cri- 
terion measures for determining effectiveness of both groups of home- 
makers were developed; validated; and tested for reliability. The instru- 
ments were developed to determine the degree of confidence a homemaker 
had in performing tasks in comparison with other homemakers. Data were 
collected from 276 homdmakers in Florida; • Georgia; Kentucky; and South 
Carolina, Analysis of data revealed that their perceived effectiveness as 
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homemakers at performing 116 specified Jnomemaking tasks increased with 
the number of years they had be6n enrolled In home economics at the high 
school level. Fulhtime homemakers who had been' enrolled for three years 
in high school home economics reported feeling more adequate at perform- 
ing the tasks than homemakers with fewer years of instruction. 

Little (1979) conducted a follow-up study of. 1974 graduates from the 
home economics education programs in the high schools In Arealvi of the 
Texas Vocational Homemaking Education Division. Th^j participants in this 
study "were {de^tified through the records of their former teachers. 
Eighty-four questl'^nnaires were mailed and only 22 were returned. They 
were asked among other things to identify, the content they learned that* 
had been of most value to them since graduation. The content that was 
reported to have the most value was how to dress; behave, and prepare 
forms when applying for a job; followed by improving relationships; money 
management; the management process, improving health practices and self 
'concept; and discovering and improving personal strengths and weak- 
nesses. 'Little found that the majority of the participants In this study 
indicated they would advise their own children to take courses designed to 
prepare them for the roles of homemaker and wage earner while in high 
school. Little had a very low number of questionnaires returned and this 
could have affected the findings. There was no report of how the respon- 
dents and non-respondents differed. 

A report of 1973-74 follbw-up survey of 2/714 (31% of the population) 
students who had studied "consumer home economics in the secondary 
schools of Alabama revealed that 74% of these students had taken courses 
designed to prepare them for personal-, home, and family living. Over 
54%. studied in these areas because they planned to use- the knowledgejn 
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homemaking. More than 66% Indicated they would take the same program If 
they^d It to do over again (Drake and Davls/1976). 
Stud^T^t Perceptions of Usefulness of C&HE Courses 

Students are generally not required to enroH- In courses offered In 
most C&HE programs In secondary jschools. ' It may be approplate- to as- 
. sume that ons reascrt why students elect to take C&HE courses Is because 
they 'think the course content will be useful to them In their present 
and/or future lives. 

Drake and David (1976), -in a study cited earUer, found that 67% of 
2,714 students in their study reported that their decision to study C&HE 
was made Independent of the influence of,othfers. Sixty-nine percent of 
the subjects reported having some plans for utilizing the C&HE content. 

Judgments about the importance and usefulness of course content are 
likely to be influenced by the real life experiences that former students- 
encounter. When former students "encounter situations in which the know- 
ledge or skills learned can be applied, then perceptions of the importance.' 
or usefulness of the subject are likely to be increased. ' v " 

Adomatis and Vanderhoff (1980) surveyed former C&HE students In* 
Indiana to determine their perceptions about whether "problem solving and 
decision making knovyledge and^ skilly were developed In C&HE programs/ 
Data^ were collected via a demographic data questionnaire, an experience 
inventory, and a knowledge and skills* inventory. The knowledge and 
skills inventory contained 64 items based on eight subject matter areas in 
the teaching resource guides used in Indiana. The experience inventory 
contained 95 problem situations which the former students m?y hrave en- 
countered. They were asked to indicate the usefulness of C&HE content in 
solving the problems. The reliability scores for the instruments ranged 
from .829 to .956. 
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Questionnaires were, mailed to persons who had graduated or left 
school between 1974-19;(8« Four hundred and fifty persons responded to 
the questionnaire.. The researchers attempted to include randomly selected 
participants from 20 high schools (10%) In Indiana. The respondents 
represented 11 high schools. . 

♦ 

The data revealed a positive relationship between the number of C&HE 
courses taken and the former students* perceptions of therr knowledge and 
skills; and their usefulness in "real life" situations.^ This relationship, .was 
significant, at the .001 leveK' Areas" j^here the respondents felt they had 
the greatest amount of achievement in ''knowledge, .skills^ and problem 
solving, abilities were nutrition and food, textiles and clothing, . inter- 
personal relations and 'child development, and management of resources. 

Hutcherson (1973) asked 176 eighth gradfe students In Pasadena, 
California, ages 12-15, 'a majority of whom had taken home economics in the 
7th grade, to identify what they thought to bo^important content in the 
home economics subject areas- The students ordered the areas of impor- 
tance as follows: child development (most interest in babysitting and 
understanding the growth* and development of children); clothing, textiles, 

related arts (learning to sew and personal ' grooming); food and nutrition 

V 

• (cooking^ sdlving family food problems and preparing' quick, Jnexpensi\/e, 
nutritious ^meals); family relationship (sharing home responsibilities and 
. getting along with family .members); home furnishings and equipment (mak- 
^ ing the home attractive, care and use of household equipment); and man- 
agement ,of resources (planning for the use of time, energy and money)*^ 
' Findlay (1976) asked a sample of 211 male and female former C&HE 
stud.ents in Utah who. had been out of high school from 3-6 years to indi- 
cate their perception -of the- importance an^ -current usefulness of hon\e- 
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making subject areas. They were asked to respond regardless of whether 

they had studied in these areas themselves. 

Ninety-two percent' of the respondents perceived moYiey management 

and budgeting as the most 'important areas. The next nine areas in or-der 

of t|ie subjects' perceived importance were: > • ' 

Child Development 88% 

Family Relations 85% 

Food Preparation ■ 83% 

Nutrition'- 80% * - *, 

Home Living . . 78% - 
Home Management, 
Organization & 

, Decision Making 76% 

Child Development 74% 

Family Health 73% 

^ ^ The' rank order of ' the top ten. cour's'es 'according- to their curi^ent 
usefulness according to persons who had taken them and th|^ percent of 
respondents' jrtfere as follows: . . ^ 

. ' ' Food Preparation "89% ^ 

Child Development 86% 

Clothing Construction 83% - 

Nutrition . - 83% 
Money Management and 

^Budgeting 83% 

Family Relationships 81% 

Home Living - ^ 79% (A composite course in- 
cluding ^11 home eco- 
' ' nomics content areas) 
Home Management, Organiza- 
tion 8c Decisioh. Making 74% 
Family Health 68% 
- Interior Decoration . 58% ^ 

More than sixty, percent of the respondents indicated they would take 
more homemaking * classes if it were possible to repeat tijeir high school 
experience. Tbirty-five percent of the respondents had at least one child 
and 3*2 percent had three or more children. 

Rusdah! (1973) sent a questionnaire to 50 former hicfh school students 
in .Idaho who had studied home economics between 1964 and 1969. The 



former students indicated that their overall instruction in homemaking 

« 

classes had been useful. The most useful course content was in the areas 
of food, and nutrition, clothing, and grooming, and family health, in that 
order. . - . 

• Bokenkamp (1978) conducted a state-wide follow-up study of the 1973 
high school graduates and school terminees from vocational consumer home 
economics programs in Nebraska. The respondents were asked to indicate 
the area in which their instruction had been most helpful to them. Those 
who responded reported they had instruction in the following: 



Food and Nutrition 65% 

Adult Living 53% 
Clothing and Textiles ]. 51% 
Housing and Home 

Furnishings 34% 

Home Management 24% 

Consumer Education 20% 



Sixty-six percent of the male .respondents felt adult liviQa^as the most 
helpful to them. Twenty-one percent of Bokenkamp's respondents had 
taken Home Economics courses for six or more semesters. 

Hudson (1974) conducted a- study iri Texas that was designed to 
determine the usefulness of competencies developed in high school home 
economics courses. . The research subjects were 20 students and 30 gradu- 
ates. Hudson also wanted to determine whether the high school students 

would rate the usefulness of the competencies different from the graduates 

\ 

who were -homemakers. The subjects who had all taken two years of home 
economics reported that they had achieved most of the competencies 
planned for the courses- and were satisfied with the curricOlum. 'The 
Students felt that four competencies were significantly more useful than did 
the graduates. These competencies were: participating in the 'decision 
making process; knowledfie of child development carpers and job oppor- 
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tunitles; knowledge of health care job" opportunities r and, the ability to 
Identify stages of love in a variety of situations,, ,The graduates indicated 
a higher mean score on the usefulness of their skill In food preparation 
than did the high school students. • < . 

The difference in the ratings of the graduates artd the students in 
Hudson's study may be related to types "of consumer and Jv^memaking tasks'^ 
that each group of subjects performed. , For example, here are two com- 
ments made by respondents who wer^ graduates that illustrate the differ-' 

'i 

ence because of experience: 

"( feel that the benefits I received in Home Economics and Family 
Living have definitely bean helpful to me in my married life," 
. 2nd: "Hardly a day goes by . . . that I don't us;e something I 
learned in Home Economics." 

Arizona provided' courses for adults in community colleges. The 
participants described those programs as being quite helpful. For ex- 
ample, Margin (1978) evaluated ^a consumer education project for low income 
senior citizens at Mesa Community College, Mesa, Arizona, and found that 
the participants considered the content they learned helpful • They re-' 
ported that they' shared the content with neighbors, friends, and family. 

The Arizona State Department of Vocational Education and the com- 
munity colleges jointly sponsored this Adult Family Living Education pro- 
gram. Its primary goal was to educate parents for effective family life 
through instruction in child development*, family relationships, home man- 
agement, consumer, economics, nutrition, and communications skills/ In 
1978-79; 1,533 persons were enrolled in 89 parent education classes, some 
of tfie' participants said: "I am a better wife and mother." I learned "how 
to feel comfortable as a^ parent" and "how to better organize myself arid set 
realistic goals", "how to handle anger and cope with getting upset," When 
asked what learning was most important or useful to them, some p^rents 
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reported, "how children develop," "teaching my child responsibility/' "time 
management/' "discipline/' "problem solving techniques/' and "nutrition." 

The State of Ohio had eleven community-based Family Life Education 
Centers In 1978 (Annua! Report, 1978)."; There -were a total of 21,380 
partlcit)ants enrolled In the centers-^owhich was an Increase of 154 persons 
over the previous year. The participants included 13,405 adults, 2,885 
"Children, and 5,090 prerschool children who were enrolled in the nursery 
program. 

Community social agencies in several large cities in Ohio requested 
that programs be conducted in the Family Life Education Centers for their 
clients. It was alsa reported that courts of law in Ohio tended to permit 
an increasing n'umber of parents to retain custody of their children if they 
participated in ,the programs. As a result of the program, some particf-* 
■pants reported gaining enojiigh control over their persona^ lives so that 
they could become employed and involve themselves in community activities. 
Sofljie participants reported they became interested in their living environ- 
ments and purchased homes and/or worked to improve their residences/ 

A sense of the feelings of learners about the effectiveaess of their 
education may be best conveyed in their own words. Such is the case, 
/the authors believe, of- the following testimony. The .following letter was 
written by a former Consumer and, Homema king Education student in Ore- 
gon and provided to us by the State's Home Economics, Specialist. . His 
feeiings may have been shared by students who did not express/them as 
eloquently as" he. , . 
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June 28, *I97^ 



TO WHOM IT MAY CONCERN: . . « 

As a m'ember of th6 class of 1972, I am writing in response to 
request made by the Oregon State 'Department of Education 
concerning the effectiveness and benefit of the pilot course in 
Consumer Homemaking I was enrolled In. 

. tf> 

I feel the Consumer Homemaking ^rid Bachelor Homemaking course 
I took were both beneficial and informative. Since graduation I 
have livea on my own, married, and begun a family; I have 
purchased a car, appliances, and most 'recently a home; I have 
managed my energy, time and money — all with the help of this 
^ background course in Cons'umer Homemaking. 

» 

I would like to see more courses directed at money management 
and Consumer Homemaking, as the information and skills continue 
to be so -vital in today's wbrld. We all, as /consumers, have 
Involvement with contracts for honjes, cars, and personals-goods 
and services. Without the background- of Consumer Homemaking 
^. a family easily might not be able 'to' cope,/ 

Having been -employed by U.S. National Bank I see a lot df 
young peopfe starting out trying tO:€stablish credit and get over 
their head in debt. Because of not being able to cape they ruin 
not only their credit, but also their family relationships, 

I certainly feel Home Economics and Consumer Homemaking are 
. ( important^ . ' \ 

A student in a class in Hampton, Virginia, described the value of 

Jtudying Consumer and Hqmemaking Education as ^ follows: 



The Values of Consumer and.. Homemaking to Me 

Hi, Vm ' in the' ninth grade at Spratley Junior 

High in Hampton, Virginia, j feel ^ Conslimer and .Homemaking 
has played an important role in my life in many ways. 

First, Consumer and Homemakipg has helped prepare rrte to 
•cope, not' only, with things J will 'have to face in the future;' but 
the present as well.- Especially the unit in - Cultural Development 
because it has . made me be' aware of the problems aroljnd me that 
in thfe past r have taken for granted. Jn this unit Ve studied 
different cultures, problems In families, "problems with teenagers 
— including dating, drugs, alcoholism, and pregnancy — rape 
and Sexuj?! assault/ divorce, the* one^parent family, senior citi- 
zei:;^, the childless couple, death and dying, and many other 
•sociafl' problems, h really got in<7olved in this unit because if 
made ftie realize how each one of these deals witK' me directly.^ 



The unit in money mariagement was also of great benefit to 
me. We found a joti, filled out the application, had mock job 
interviews and drew a paycheck. Now on our own we had all 
•the responsibilities that we thought we had always wanted. We 
were to pay all our bills, Including rent, telephone, electricity, 
. clothing, transportation and others, including a few unexpected 
k bills. We alj soon realized how important a strict budget Is and 
found out how to really stretch our budgets. I made it and^had 
a few dollars left. 

*" » ^ 

In this unit we also studied_about gyps and frauds, con- 
tracts and credit. This unit was helpful to me and one In which 
L plan to save a!l my notes! 

When' sqmeon'i mentions Home Economics, we automatically * 
think of cooking and sewing. We covered these units also. 

,l> won't go into the clothing m'anagement unit too much. 
- Swelng. isn't my bag since I have little patience, .but J do feel I 
benefited froirt the^section on clothing selection, especially colors 
* •• and designs appropriate for me. ■ ^» 

The Foods and Nutrition ^nlt was great fun and a learning 
experience as well. My family has enjoyed all my experimenting 
^ and I feel I have been a help -to my mother -In planning our 
meals and *shopping. 1 corrie fi^iom a large family and we have 
problem, getting the right nutrients, keeping our weight down 
and keeping the cost low. I feel Home Economics has helpjed me 
help my family in this respect. . 

- All in all,. Consumer and Homemaking has stremgthened me 
In many ways that I, a homemaker of today, can pass along to 
others. Pn/ glad I took It for two years 'and hope. I can fit It 
into jfiy spKedule In high school. . ^""^ 

Impact on Behavior • . ' 

The research cited ^n -this section describes the relationship between 
C&HE programs and student behavior. The data collected In most of the 
.studies' are students' self reports of their behavior. . 

Lockhart (1978) compared the reported purchasing habits of 'adult 
students who, had successfully completed -^t least one commi/lty college 
course In,, Consumer and Hbmemaking Education with adult students who 
had not taken such courses. Datp collected via a thirty-three Item pur- 
chasing habit Inventory .Indicated a difference In the purchasing beha<^or 



of the two groups ^that was signlflca'nt at the .1)5 level. She found that 

students' knowledge of consumer^ education* was reflecte'd Fn thjeir repprted 

cortsumer .decisions relatecJ to the purchasing of good^and ser;vlces. > • 

Crawford (1980) compared the rep9rted consumer -practitces of a group 

of homemakers who had studied consumer education wifh ai9roup who hab 

not. The two groups ^of homemakers- reported having similar consumer 

responsibilities;- hoWever, thqy approached them differently. The former 

hQmemaklng students were moce Mrkely to (1) consider the wear life, ^re, 

and^ fiber content 5f clothing parlor "b purchase; (2) consider sales and- ads. 

wHen shopping for food; and/ (.3) pl^ purchases costlny '$25 ..00 through 

$100.00 "and consider sjjeclal features of the store wh^n^the purchase was 

made* " v ' 

Paulsen (1974) surveyed 54 former Students to determine their use of 

\ the knowledge gained In a specjflc are^ of .C&HE. Her subjects were 

persona who had studlejd clothing^and textiles between 1969 and 1973. She 

Studied the former students* use and -knowledge of consumer information, 

clothing selection, fabric properties, and clothing -construction and altera- 

tion. "^he found that respondents who had not learned 'how to manage the 
• - % 

use of credit In high school reported using credit more frequently than 
those who.-liad. Also former C&HE students did report utilizing their 
consumer knowledge In ciothlng selection in such ways as reading hangtags 
and labels* They^ also repprted utilizing their clothing construction and 
alteration skills* . 

pougherty (j 977) collected self report and observation data on'dis- 
advantaged adults enrolled in^ C&HE programs in Wisconsin. ^ The data 
revealed that some of the participants had improved family relationships, 
increased ability to manage resources, increased ability to secure and keep 

' ^. * 
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jobs, increased understanding and application of principles of child devel- 
opment, and, increased positive feelmgs about themselves.* 

> Schwartz (1973), in a study previously cited, found that high school 
graduates who were enrolled in C&HE courses reported significantly better 
nutrritlon practices than graduates who had not been enrolled In C&HE. 
Data on nutrition practices consisted of a three-day dietary recall and 
Information on the subjects' use of nutrient supplements, use of fat and 
salt,' and average weekly consumption of snack foods and pastries. 

IVIumme.(l974) "found that students volunteered to work with children 
outside of class after th.ey had been Involved in a six-week unit on child 
development. This was perceived- as an mdlcatlon of Increased- interest 
that influenced studeht behavior. ^ 
Summary 

Are C&HE programs effective? What effect do C&HE programs have 
on learners' knowledge, attitudes and behavior? , • 

Many of the studies do provide data that suggests that C&HE pro- 
grams are effective, even though many of the studies -> cited In this report 
tend hot to be widely generallzable and- the findingslin a few studies did 
not show that C&HE programs make a difference. The bulk of the re- 
search focused on specific C&HE courses and not total programs. The 
research findings are not conclusive and the limited generalizability is the 
result cf one or more of t!'e following: < 

' The research subjects were often corflposed of intact groups 
enroHed in a school class who may not have been representative 
^oi the population of persons enrolled in C&HE. 

- 

.2. Toilow-up studies in which, data were collected via mailed ques- 
• ^ tionnaires had return rates of Ie5s than 50%. Non-respondents . 

were not sampled and compared with the respondents. 

3. The subjects who Were students tended to have been enrolled in 
courses that were unique to given school. There were wide 
^ variations in course content and instructional methods • 



4. Descriptive research designs were frequently used. In such 
, cases, control group data were not available for purposes of 
■ comparative analyses. 

" 5^ — T-heHack of ability to control for the previous C&HE learning 

experience of the research subjects. 

With these limitations' In mind, the following is a summary of the 

findings on the effect of C&HE programs. 

. Impact of C&HE Programs on Learners' Knowledge . The studies cited 

In this section of the - report showed that: 

1. X&HE programs were related to positive achievement in nutrition 

education, child development, and consumer education- 
's- TWiSHf^'was a" positive, relationship between the amount of time 
spent in a course,^ the number of courses taken, andean increase 
in knowledge- . ' 

Impact of C&HE Programs on Learners' Attitudes - Studies that fo- 
cused on the relationship between C&HE programs and learners' attitudes 
toward self and the value of their instruction revealed that: 

" 1- students in child .development and family life education classes 
expected their marital roles to be more egalitarian-' 

t 

2- Students i^ child development classes had increased awareness of 
and sensmvity tp the needs of children- 

3- Former C&HE students had positive feelings about the usefulness 
and importance of the program content- 

4- There has been an increase in the voluntary attendance of adults 
in C&HE prog rams - 

5- Students' attitudes about nutrition education as a course of 
study became more positive- ' 

6- There was ^a positive relatiohship between the number of courses 
taken and -feelings of adequacy in performing homemaking tasks- 

Impact of C&HE Programs on Learners' Behavior . Studies of the re- 
lationships^ between C&HE programs and learners behavior found that: 

■f w 

1. Former C&HE students had better nutrition practices than non- 
C&HE graduates. 
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Students who had been Instructed in the use of consumer credit 
reported using credit less often than students who had not had 
the instruction. 

•Former C&HE students reported using consumer knowledge »to 
make consumer related decisions* 

Adult C&HE students reported improved management of money 
and time. 

Students in a child development class volunteered to work with- 
children outside of class • 
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PART il 

Research On Consumer and Homemaking Education 

In order to answer the question, "How effective is C&HE?" additional 
^research will be required. A review of the preceeding section jof this 
paper will identify the need for research in C&HE. The limitations of/-t&7 
studies cited in the previous section provide the basis for the following 
list of basic recommendations: . ^ . 

1. . Include a representative random sample. v 

2. Have geographic representation included in the studies. 
3- Include some longitudinal designs., 

4. * Measure impact of the program on the learner. ' ^ . 

Consumer and Homemaking Education research has been neglected 
'during the development ' of projects of the past decades. - Many of these 
projects have been to develop curriculum. Because research is expensive 
in tim^and money and very few funds have been invested in research of 
an evaluative nature, Very little has been completed during the past de^ 
cade as cited in the first section of this report. * , /• 

^ As the value of research to determine and/or aSsess the worth of a 
program becomes mora apparent because of emphasis on accour^abilityv 
several states and professional organizations have launched research ef- 
forts to aid them in answering previously unanswered questions. Monies 

previously directed toward other research and development goals have 

/ 

begun to be used to determine the effectiveness of a program. 

< 

In summary, more bro^d-based and better quality research is needed 
in C&HE. The research that has been reported to the authors of this 
report as "underway" reflects that some of these needs are beginning to 
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be addressed. "Additional funding directed toward this type of research 

would enable a comprehensive Approach not currently feasible. 

Traditional Effectiveness Evaluation Design 

..." » , . 

. . The research designs that have bleen traditionally used to measure 

effectiveness include the pre-experlmental", tjie experimental, "and- the 
quasi-experimental. Campbell and Stanley (1963) present a thorough dis- 
cussion of- each pf these designs. • 

-The -most common design and- the one open to' the fewest threats to 
validity is .the pretest-posttest control grbup experimental design, this 
design is" frequently used to 'measure the growth of students enrolled in 
' C&HE courses "and to compare thaf growth Xp the growth of a control group 
that did ndt have the" C&HE feourse. It is important to select a control 
group that is simllai^ to the experimental group in ability, ag^, and otheV 
demographic variables." ** • ' 

^ Evaluation *of educational programs for the purpose of determining the 
effectiveness of- those programs can take different forms. The experi- 
mental research design is one of those forms. Other, evaluations include 
forms such .as process and'product evaluation and formative ind summative 
evaluation. Evaluators, are continuously searching for additonal methods 
for assessing the worth of an activity, prjogram, or coyrs^e. Some of these 
alternative evaluation designs can be useful in assessing aspects of a 
program that are difficult to measure by traditional research designs. 
Some of the alternative designs thoug'ht to be useful- are reviewed in the 
next section. * 
Emerging Effectiveness Evaluation 'Designs 

There are some alternatives to * experimental re^arch design^ that 
m^rit consideration-- for evaluation research. There will be pertinent ""data 
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that wilt etude the rigor of the experimental research design since the 
'"useful" vocational programs such as home economics Include content based 
in both the disciplines of the physical sciences as well as the social scl- 

I 

ences* A review of some of the methodologies researchers may want to 
consider to accompany the experimental * research designs is presented in 
the following section. 
Naturalistic Inquiry 

According to McKinney (1978, 1) "naturalistic inquiry has evolved 
from ethnology and phenomenology." McKinney (1978, 4) asserts that "the 
•ideal' experiment requires - high constraints on the dependent and inde- 
pendent 'variables" .'. . while lii "the 'ideal' naturalistic Inquiry the 

• * 

.investigator does not manipulate the dependent or independent variabtes." 

Some of the early work on naturalistic inquiry was done by Willems 
and Raush (1969) who define naturalistic inquiry as . • • "the investlgar 
tion of phenomena within and in relation to their naturally 6ccurring con- 
texts." Willems and Raush (1969) explained that "the purely naturalistic 
study is one in which the investigation attempts^ to exercise no influence 
over the range of stimuli^ or the range of responsee; "it is tfie subject who 
selects and defines the repertoire of both stimuH and>esporises." Some'of 
the 'early work on naturalistic inquiry has been done b/ Cuba, who con- 
tinues to publish on this method. Cuba (1978) describes the difference 
between experimental arfd naturalistic inquiry by suggesting that: 

.... a study can be characterized^ as experimental .or natural- 
istic as a function of .where it falls along two dimensions of 
manipulation by the investigator: the manipulation, of stimuli^, 
^ and the manipulation of response modes, or at least, the desig- 
nation of which responses will be noted. 

McCaslin (1978, 4) presented several r'easons why naturalistic inquiry 
might be an appropriate mode of inquiry for effectiveness evaluation. 
Reasons considered most relevant are: 

54 •• ./ 
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-1. ■ Naturalistic inquiry is a .legitimate evaluation methodology in'^hat 
It is structured/ disciplined, systematic, comprehensive, and 
replicabic. 

2. Naturalistic inquiry recognizes the multiplicity of causes associ- 
ated with given outcomes in vocational education. 

3. Naturalistic inquiry evaluates vocational programs as they actu- 
ally occur, , 

J* * ' • 

4. Naturalistic inquiry is not constrained to examining only those 
outcomes that are amenable to quantification . 

5. Naturalistic -inquiry can be individualized to meet the needs of 
diverse people. - • * 

it is oniy fair to report that PuceiToSTsT^O) was critical of the 
degree of •freedom permitted in naturalistic inquiry primarily due to the 
magnitude of the r&spor^iDiilty placed cVi the observer in relation to accur-' 
acy, reliabllif^^ and validity. He went on,,to say that while he believes- 
naturalistic inquiry has a place in educational decision-making it "is" not a 
reasofsabls substitute for research." 

Naturalistic . inquiry Is a method of evaluation that could -serve the 

C 

"useful" vocationa! ■^ir'^qr^rris well because of the following reasons: 

1. The researcher cgn allow the research to assess tHe multiplicity 
of causes associated with outcome. 

2. It allows the researcher to evaluate programs as they naturally 
occur. ^ 

3. It permits assessment of outcomes difficult to .quantify, (i.e.; 
self concept, student motivation).- 

4. It can accommodate iridividualized -assessment procedure that will 
all^w for individual differences. 

An interview schedule that would allow for the collection of data at the 

entry and exit int^^rvicws of ths vocational students Would be one way of 

using this evaliiatioo method to provide data in addition to that gathered 

by quasi-experimentaf research methods. 



• . • • 44 

Modus Operandi ■ \ ' . 

^ . Michael Scriven (1976) proposed a more extensive use of causal rnves- 
tigations known .as the modus operandi '(MO) method. This evaluation 
method is one where the resuji/are acknowledged arid a "search .i^ initiated 
for the cause of the giv^fn results\ Perhaps many of the successes of the 
"useful" vocational programs are . causal rather than predictive. The 
programs 'work with individuals who have unique nee^and perhaps it is 
the ability of the teacher and the flexibility of the instructional program 
that allows the teacher to tailor the treatment to the need that results in 
success rather than that a'-given treatment always and predic|ably nets a 
positive response. . ^ ^ 

Goal-Free Evalua tion 

t 

In order to avoid evaluation bias caused either by. former association, 
a^commitment due to some prior role in decision-making, or by the enthu- 
siastic presentation of the program producer, some effort has been made to 
test a. model of evaluation aimed at securing in^rmation from the perspec- 
tive of the user. TRis method of evaluation is called goal-free evaluation. 
Scriven (1976, 137) expands on the merits of goal-free evaluation (GFE): 

... It is ^tremeiy important as a -nethodology for avoiding 
over-favorable evaluations* and for detecting side- effects.' Since 
one has not been toi.d ^hat the intended effects -- goals — are, 

^ one works very hard t%Jiscover any effects, without the tunnel 
vision induced by a brieffhg about goals. If GFE. sometimes errs 
ia the direction of being Jtoa. critical or missing a main effect, 
the/ cost of those errorif is insignificant because they ca n be 

^ picked up at the debriefing . , 

i> 

Evaluators have been assigned the task of evaluation of a given propram 
without being briefed on the objectives of the program. Some unusual 
factors are discovered by these "unprogrammed" evaluators. 
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Regression Discontmuity Analysis 

Campbell (1971^ 248). recognized that there mSy be ^imes when ran- 
domization Is deemed impossible or not morally justifiable. He proposed- a 
quasi-experimental design not in common use described as follows- 

. . . •. If randomization is not' politically feasible or morally justifi- 
able in a given setting, there is a powerful quasi-experimental 
design available that allows the scarce good to- be given to the 
mo?t needy or the most deserving. This Is the regression dis- 
. contmulty design. -^'All it requires is strict and orderly attention 
to the priority dimension. The design originated through an 
advocacy of a tie-breaking experiment to measure the effects of 

, receiving a fellowship (Thistlethwaite & Campbell, i960); and it 
seems easiest to, explain it in that light, ' . , . Full randomiza- 
tion of th'e award was impossible given the stated intension to 
reward merit, and ability. But it might be possible^ to take a ' 
narrow band of ability 'at the cutting point, to regard air of 
these persons -as tied^ and to assign h^lf of them, to awards, half 
to no awards, by means of ^ tie-breaWng randomization.' 

The. two groups formed by virtue -of being .just above or just below the 
cut-of| point are compared on points of importance relevant to the 'res^ar':h 
question. This could be used to select the final students admitted to a 
vocational -course irr^-^wHTch demand exceeds the number of students .that 
can be- accomfriodated in the- course. The final 3-5 " students could be 
selected 's&t random from the 6-10 who were ranked next for admission. 

— ^W^e students who were in the final* group to enroll would be con- 
sidered ti^q__^perimental group and those who were rejected vyould be 
considered I the control group. This method of selection would elicit almost 
as- rigorous a research design as the experiment design and is a much 

I 

more feasible research design with the C&HE programs. 
Goal Attainnrfent Scaling 

^Goal attainment scaling, as used in the mental health field, is de- 
scribed by Kiresuk and Lund (1976). The technique has the advantage of 
accommodating both process and , outcome measurement of services and 
benefit to individuals being served. The techniq'ue is advocated on the 



premise that It does not evaluate the program per se, but rather evaluates 
those served on their -pr^^gr^s toward* their unique goals, The manipula- 
tion of the "unique goals^' to show positive results would undoubtedly be a 
concern levied by the critics ;of this informal research methodology. 
However, if used as designed, tWs method could provide findings that 
would. supplement other, more rigorous research effort. 
Summ'ary 

Five methods of inquiry, that can be used J:o supplement experimental 
Vesearch, have been described and discussed in this section. /These, meth- 
^ods have bden introduced in order to encourage C&HE researchers to use 
'some of these techniques to support the experimental or quasi-experimental 
research studies they have underway or plan to launch'. 
Errors and^ Limitations 

Sound research designs avoid as. many potential errors and limitations 
as possible. The. threat ^of calling .something significant" ivhen i,t is not 
significant, common(y called a Type I error, challenges all researchers. 
To commit a Type I error needs to be systematically avoided. . A Type II 
error is equaliy^'as threatening to -researchers,. To cajl something not 
sF^nificant, when in fact it is significant, is also a serious error. 
Reality and Validity 

other threats to the reliability and validity of research findings can 
be avoided by establishing and/or documenting the reliability and validity 
of test instruments or evaluation measures used in the study. Essential 
steps for valid data collection include: 

1 . Using an instrument in the way it was designed and with sub- 
jects for whom it- was designed .» 

2. Collection of data in identical banner for each subject. 

3. Administering and .scoring- instruments per directions. 
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Consumer and Home Economics researchers need ~ to be cognizant of 
' the fact that a threat to the "experimental design is posed when the treat- 
ment being studied is most likely to be used to treat individuals who" have 
a specific need or a specific gift. Either case will ^bias the study; the 
former in" a negative • and the latter in '.a positive direction. Campbell 
(1971, .256-257) illustrated: 

. . . First; there are those treatments that are given to the 
most -promising; treatments like a college education which are 
regularly given to those who need it least. For these,, the later 
■concomitants of the grounds of selectloa operate Jh the sams' 
direction as the treatment; those mosHlkely to achieve anyway 
get, Into the college most likely to produce later achievement. 

• • • t ' ' 

... At the other end of the talent continuum ar6 those re- 
medial treatments given to those wha'need it mos,t. Here the 
laten concomitants on the- grounds of selection are poorer sue- 
^cess. 'In the Job Training Corps example, casual comparisons of 
the later unemployment rate of those who received the training ' 
with those who did not are in general biased against showing an 
advantage to the training. 

, It is important to determine if the abilities of students in C&HE pro-. 

grams can be expected tp bias the* results of an experimental research 

design.' if the students, who enroll in C&HE programs are nonacademic, as 

IS' frequently claimed, perhaps there is a negative bias that cannot be 

avoided; however, an ^awareness of .this condition should allow the re- 

searchers to explain it. A comparison of the I.Q. or other standard 

achievement test scores of" C&HE students with the control group would 

allow the researcher to predict the degree of negative or positive bias that 

could be expected in the data. An analysis of the ability of the C&HE 

students Is recommended to. determine that they are no different than their 

comparison group; or that they are different and the direction of differ- 

eoce. 



ERIC ^ , 



Need for Multiple Research Projects 

Campbell (1971) * cautioned against deqision-maHing based on a*^ single 
^experiment. Plans for -replication could be underway before an original 
experiment is completed when* a decision is^to be influenced by data being 
gathered. ♦ 

\RossI (1971,^280) urged researchers to consider powerful research 

r 

# 

designs since effects . may "appear negligible if a design is weak: "Since 
there is suQh a high likelihood of^ small effects, we need very powerful 

research designs to get clear results." When .evaluation research is ex- 

t 

pected to' influence decision-making, Rossi (1971, 281) proposed that a 

tvyo'-phased strategy be considered. Thls^ two-phased strategy would 

include phases he described as: * , ' ^ ^ 

. . A recqnnaissandfe phase a rough ^screening in which the 
.soft /and the correlational designs filter out those, programs ^ 
worthwhile investigating further^ and 1 experimental phase in 
which .powerful contr*olled experiments are used to evaluate the 
* relative effectiveness of a variety/of those programs already 
demonstrated *to be worth pursuing. 



The C&frlE research true r'andomization is ethically,' if not morally, 

difficult because students elect, courses (in alf but Vare cases). If true 

randomization were to occur, some of the students who have elected to 

take a course would be deprived of that opportunity. Should the C&HE 

researchers .generate an "empty" cours'e for the control group for purposes 

of research? Campbell would likely answer in the affirmative. Further 

review and discussion of this Issue is heeded. ^ * 

, CoI.eman (1971, 283) spoke to* the vpeed for longitudinal research to 

accompany other research: 

. . . One of the difficulties faced in/ evaluation of a given pro- 
gram' designed to serve a client population is the problem that 
final effects of the program may be very difficult to detect, or. 
may in some cases be detectable only after a period of time. 
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: Thus^ . evaluation . .h^searc on .these ultimate 

effec^ may ^be u,nab|e to' cletect effects that m fact exist. For 
this reason/ It is useful to consider a -kind of evaluation that 
focuses on the region between inputs and effects. . . . ' 

It Is especially appropriate for- research on. the effects, of C&HE programs 

to focus on the accomplishments from the time of entry to completion of the 

program in the opinion of the authors. Some longitudinal research efforts 

are also needed to determine the long-term effects of the C&HE program. 

However, C&HE cannot accept exclusive credit or responsibility for' all the 

•social ills such divorce and child ajause, that is a one-semesjt'er course 

in child cr parent development in high school of approximately ^100 

hourS/ cannot he condemned if it does not influence the behavior of a 

parent for a lifetime nor applauded- because it was ^the sole source of 

prevention of such social ills in those cases where social ills were absent. 

Examples of Effectiveness Research 



— ^ — \ — Effecti\^ess— research— i^s— 

'"'Taimber. of social programs in the ^njted States. Select examples of effec- 
tiveness research will be reviewed* in" this section, in order to illustrate 
appropriate and inappropriate methodology and^ assumptions- " Mental 
Health/ Head Start, and Employment ' and Training Programs have each 
been the focus of major evaluation research efforts designed to determine 

^.^the^jffecitlveness' of the respective prog r^irts. A summary pf^ch of these 
evaluation research studies will be include'^ in , this section. A numbeP'tSf' 

"pother social an^^ducationeil programs such^'as Cooperative Extension and 
Job Corps have also been evaluated in the recent past but will not be 
summarized herelnv>5jnce the methodology and assumptions in the studies 
selected to be reviewed include the information pertinent to C&HE re- 



search. ^ 
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The evaluation of both Head Start and the Employment and Training 
Programs was mandated by Congress. The limitation resulting from the 
confining time line carried by the mandate was responsible for a' number .of 
the ijiethodojogical questions. Caution should be exercised by social pro- 
grams to avofd sucji compromise. Concerns related to the evaluation of 

each .program will be described briefly* below. • , * 

♦ 

Head Start 

The Head Start Program evaluation complected by Westinghouse in the, 

late "60's"' has been subjected to serious criticism since Its release. A 

* d 
brief review of the major criticisms -of the* Head Start evaluation will be 

presented in an effort to'help the C&HE researcher^s to avoid similar de- 

sign errors, or' if hot errors, at least threats' to wide acceptance of the 

findings. Studies of Head Start conducted in the "70^s" avoided some of 

the errors of* the earirer study. ' Nevertheless^ the errors of ihe earlier 



study are appropriate for review— here. -The Westinghouse study was 
considered to have had too narrow a focus becax^se it evaluated only cog- 
nitive and effective; outcomes. While Evans claims that this resulted from a 
•conscious decision on the part of the research designers^ the critics sug- 
gest that since these were not the only objectives qf. Head Start programs, 
conousions about the impact of. the program could not be accurately evalu- 
ated without also evaluating the other objectives, including the changes in 
health, nutrition and other- cbmmunity goals influenced by the Head Start 
Programs. ' 

Secondly*, the study is accused of ' lumping^ data from all Head Start 
f>rograms together; this fails to allow the superior programs to be identi- 
fied and the unique .characteristics of these programs to be selected and 
promoted. Evans (1971) suggested this was due to ^the fact that the pur- 
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pose of this evaluation was to provide an indication of the overall effec- 
tiveness of the program. However, the inevitable condition of "regression 
toward the mean" was in effect and no program appeared to be- effective. 

.When researchers are being urged to aggregate data, the simple, 
phenomenon ,of regression toward- the mean is frequently responsible for no 
statistical I significant difference. * Consumer and Home Economics re- 
searchers need to be aware of. this phenomenon. 

Other criticisms acknowledged by Evans (1971, 401-407) of the meth- 

' odology used fn the Head. Start study included: 

* " 'i 

l-^ Small sample size (i-e,, number of; full-year Head Start centers, 
selected). 

2. Sample not representative ti-e,, iriany of randomly selected cen- 
ters were eliminated and had to be replaced), 

3. Instrumentation not standardized (i-e,, cognitive 'and affective 
0 assessment instruments for this age group were in an early 

. uevfciopmenl^i stage and were not developed for the disadvan- 
-^ged^opuJation~teste<d-)-* . ___ _^ 

4. - Ex post facto design (i.e., the generation of control group by 

matching Head Start children with non-Head Start children, post 
> facto cannot assure the two groups were equivalent before treat- 

ment).- 

5. The, study tested children each of three years after attending a 
Head Start program .(i.e., Jhe conclusion that Head Start pfor 
grams do not have appreciable effects ^ does not consider the 
possibility that the effects need .reinforcement or can be ex- 
pected to 'fade out over^time). 

6. The control group was in the same classroom as the experimental 
group during the three years these two groups were tested and 
compared (i.e.. It is unlikely that the students in the control 
group were not influenced by the students who had been in the 
Head Start program). ^ 

7. Studies that are not methodologically sound may generate infor- 
mation that poses a serious threat to the continuation of the 
federal funding and thus the survival of such programs. 

After reviewing the criticism of the Head Start eva^ation, one is 

prompted to reflect o.i whether any major evaluation effort that must ac- 
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cept. several compromises in design should be conducted. Whether this is 
because of limited funding or a limited time frame, the completion of such 
an evaluation study may be a serious and unwarranted threat to the pro- 
gram. 

Mental Health ^ 

Mental health program evaluations have been initiated by those re- 
sponsible for mental health program leadership/ The sophistication of the 
..design being developed may offer some encouragement for the C&HE pro- 
gram evaluators* According to Ciarlo (1977) the total evaluation program 
has not matured to the^point 'It is 'or can be .utilized in the regular deci- 
sion-making and program monitoring process^ 

The methodology of the mentaT health evaluation project merits further 

consideration by C&HE researchers. The mentarhealth follow-up data were 

gathered by means of a questionnaire administered by' a non-professional in 

_ • ' ^ ^ 

a face-to-face Interview -in a client's own home. This method was selected 

to reduce the bias to the data produced when clients were motivated to 
"please-the-doctor" or similarly to "please-the-teacher." The fade-to-face 
mode^ was selected to avoid the selective elimination of the clients who had 
no telephone br were unable to read or write, ^^as well as to secure more 
accurate information from clients unwilling to be frank or truthful wherK 
completing a mailed questionnaire* 

The plans for analysis, interpretation, and utiization of the follovv-up 
data from the mental health clients also merit further consideration by the 
C&HE researchers. Basically^ the mental health system includes the com- 
parisons of client data with questionnaire responses from a random sample 
of the total population in the community served by the given mental health 
program* The questionnaire is standardized on a random sample of the 
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population. Thrs enables the evaluators to c6mpare scores of clients at the 
time of intake, as well as follow-up, with the non-cilent community norms. 

. Ciarlo suggested that plotting the data on a graph permits a visual 
comparison of the progress or lack thereof. When data are continuously 
gathered and reported by a. graphic means it allows and encourages utili- 
zation for decision-making. Clarfq ^(1977, 649) said that a continuous 
"picture is generated of iiow typical client groups are functioning at intake 
relative to the . . . community, how much better (or worse) they are 
furictioning at follow-up, and how far they are at follow-up from the . . . 
community average In each functioning area." 

The graphic presentation also promotes the rapid identification of 
dramatic change In' the clients and the variables that niay have some rela- 
tionship to the change. This is especially useful when the change is in 
the negative direction. - Accurate records and graphic presentation of 

program accomplishments would be useful, for the'C&HE evaioators, 

Employment and Training Programs 

In 1976 moihe than nine billion dollars was spent for training/ place-,- 
ment, and work experience programs. Fifteen years earlier the dollars 
spent on such programs was less than one-quarter of a billion. Questions 
related to the effectiveness of such programs and concern over this sub-* 
"stantial investment have been frequently repeated. Prior to the Compre- 
hensive Employment and Training Act of 1973 (CETA) there were numerous 
federally funded categorical programs with unique but similar manpower 
objectives. 

After fifteen years of experience and millions of dollars spent on ' 
research and evaluation, the National Council on Employment Policy (NCEP) 
-(1977, 687-689) offered a list of four very braad but positive outcomes in- 
eluding: 
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• 1. Improved economic well-beipg of the participants. 
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"Benefifs usually exceed costs in doljars and 'cents, however, 
benefitrcost analysis • cannot serve as a primary measure of 

-effectiveness because of its inability, to measure important related 
factors . ' 



3. Reduce poverty and reduce unemployment. 

4. Effectiveness of employment and training programs have unan- 
swered questions. 

Decision-making standards that influence "employment and training policies 
must rest on informed judgments rather than unequivocal findings," ac- 
cording to the National Council on Employment Policy (1977, 679J 

According to the NCEP (1977, 690-691), some of the threat\ to the 
claims of the employrfient and training programs are: 



I intervening variables (i.e., employer, home, andf family 
3ility, etc.) which prevent the training 'programs from ascrib- 



1. The 
stabi 

- 4ng-^he 5uccess-directly-^to -the srvices received from the- given 
program. 



2- The questions related to a' control group, for to have a group 

PandomLy_assigned„to„.be the control group would be to deny 

, training and employment services to some of those desiring such 
services, and any other method used to select a comparison 
group may identify individuals with different attitudes and/or 
different degrees of motivation, 

3. Differential success of enrollees compared to controls may be 
inaccurate; if the employment and training program has a corner 
on the job ^market it may become a rationing mechanism rather 
than a training program. 

4- The duration of impacts may deteriorate over time, especially if 
the control group contains a disproportionate group of students 
in college or technical training programs. 

The NCEP (1977, 693) concluded with a postive, yet unproven posi- 
tion in relation to the effectiveness of employment and training programs. 
They report "that practical and theoretical problems seriously limit what we 
have learned and can learn about effectiveness of employment and training 
programs. Despite our best efforts, the rigorous, unequivocal answers 
desired by policymakers are not available and are an unlikely prospect." 
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I'he NCEP concludes that the worth of the Employment and Training 
Programs cannot be proven beyond a reasonable doubt, yet the weight of' 
the evidence is unquestionably positive. They also assert that they can 
prove that the effects are positive in relation to some questions • 

Perhaps the C&HE researchers and evaluators need to assert the 

positive direction of the evaluations even if the degree of the impact is not 

as certain. To continue a debate about the accuracy or inaccuracy of the 

measurement instrument or system is sterile and unproductive. 

Important Research Questions in C&H E 

" ■ » 

Research h^s been conducted to determine the impact of certain 
factors on student achievement in*^C&HE- Additional research in this area, 
as well as research to define the nature of the C&HE student and long- 
term and short-termveffects of C&HE on the leartner, would provide i data 
base upon which rational decisions could be made. 

The following list of questions are some of the questions the C&HE 
researchers need to begin to answer: 

1. What are the characteristics of C&HE students and to what 
extent are they like their high school counterparts who do not 
elect to study C&HE?. . ^ T n 




2. What are the long-term affect^^f C&HE instruction on learners? 



3. What affect does C&HE Instruction in each' subject area ijiave on 
student achievement, attitude, and behavior? 



4- What factors affect curriculum decisions about C&HE couii'se 
offerings and course content? 

Some studies have reviewed the factors, that influence student 
achievement in C&HE such as teaching techniques, learning environment, 
student motivation, teacher preparation, teacher commitment, and curricu- 
lum content. Additional research is needed regarding each of these fac- 
tors because as students change, the way each factor influences learning 
will differ from the way it affected students when they were different. 



Research in Progress ^ 

fndlcation? are that in the future there will be considerably more data 
Reliable on the effectiveness of Consumer " and Hqmemaking Educatibn 
^Programs. ^Responseo to the request for available data for this report* 

indicated thai' state-wide studies are now underway in Califorhia, Indiana, 
•'^lowa, Kentucl<y, Minnesbta, Missouri, New Hampshire, New York, V:r-5inia, 
and West Virginia. 

The l^owa Consunf^ and Homemaking Education Project will focus upon 
assessing the effectiveness of Iowa program^ in three content areas: 

1- Consumer e^iucation/management 
^ 2. Parenthood education 

3. Nutrition and food use 
The study will include high school seniors and' a follow-up of them six 
months after graduation. The State Director for Home Economics Education 
in Kentucky reported that state will begin a three-year follow-up of per-' 
sons who completed courses in Consumer and Homemaking Education. This 

study is expected to focus on the impact of these ^programs on learners. 

> 

The impact of Consumer and Homemaking Programs in Indiana second- 
ary schools is being studied. ^The objective is to obtain a measure of the 
perceptions of former^Jponsumer and Homemaking Education students about 
the effectiveness of the programs in that state. An interim report of this 
study was cited in this paper. 

The need for such research has become apparent in recent years; 
therefore, funds are gradually being made available to support such re- 
search. Most of these funds tend to come from individual states rather 
' than directly from the federal agencies. Research in C&HE is a new 
, priority of states. State funds in the past have tended to be earmarked 
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for developmental activities. Research is needed to study the effectiveness 

« 

of these curricula and materials as^ instructional tools. 

\ 

Federal funds are also needed to support some research efforts that 

may extend beyond the needs and Interest of any given state. Federal 

funds, for example, can be used to support research that utilizes national 

samples rafher than limited intact classes, to establish and study regional, 

and/or national experimental C&HE programs for youth and adults, and to 

t 

conduct longitudinal studies on the effectiveness of C&HE. 

The review of research reports for this paper revealed much variation 
in programs for youth and adults. The questions l5eing addressed in this 
report may seem to imply that all C&HE prqgrams are alike, but this is not 
the- case. National comparative studies that take into account these /varia- 
tions and longitudinal studies that can assess impact over time also need to 
be conducted . ^ ^ ^ 

The C&HE leaders in the Home Economics Division of the American 
Vocational Association organized an Ad Hoc Committee that has encouraged 
the development of several research projects. The "census" study under 
the leadership and direction of Dr. Ruth Hughes is nearing .completion. 
This .study was to determine wf}o the students were who. were enrolled* in 
C&HE and in which C&HE courses they were enrolled. Initial steps were 

also taken to determine the content of the C&HE courses in which they 

'J 

were en roll ed* 

Other evaluation studies have been initiated by the Ad Hoc Committee 
cited above and several of these are nearing completion. „Only the "cen- 
,sus" study is a national pne; however, some of the other studies hgve 
used a*^multi-state population. 

. . C . , ■ 69 ' 
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Summary ' . * ' . 

Rigor in selection (qr development) and use of an instrument are 
essential fpr valid and reliable data collection. Both Type i and Type ll 
errors should be avoided. At the prjesent time/ limited effectiveness data 
are available for C&HE. Since there is a need for decision-making to be 
based on research findings, additional evaluation research is s^iously' 
needed. ' - . ^ ' * * * , ^ 

The nature of the subject^ (either above or below average) will- bias 
the findings.'^ Therefore, researchers evaluating social programs for either 
above or below -average subjects need to be aware of this phenomenon and 
account for it in the analysis of the data and in the reports of the find- 

^ The findings of a single study do not provide adequate' evidence for 
decision-malting in the' social science areas. Findings of multiple studies 
will support and ccmplTment each other and form a solid base for decision- 

' making. Longitudinal studies provide some kinds of data not available 
from any other type of research. • 

Evaluation research studies have been conducted to determine the 
effectiveness- of other social* programs including Mental Health, Head Start 
and Employment and Training Programs. Evaluation of the two latter 
programs was mandated by Congress. 

Evaluation research studies need to have a rigorous design in order 
to provide valid and reliable data upon which to determine the effective- 
ness of a program. The value of data gathered from a study where ex- 
tensive' compromise must be made in " the research design « is seriously 
qu^tioned. ^ 
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Studies of gn evaluation nature, other than a research design, gener- 
ate supportive data that are very useful to explain Questions that have not 
beeQ^nswered by -evaluation research. SupplementaK^tudies enable deci- 
sion makers to have more than one source of information. There are 
several social ^programs for which it has not yet been possible to generate 
unequivocal evidence of effectiveness. However, the data availabJ.^ are of 
a positive nature for several of these program's, including C&HE. 

Additional research is' needed to determine: 

1,. the characteristics of the C&HE students.' 

2. long-term affect of C&HE programs on learners. 

3. change-in achievement, behavior,^ and/or attitude of the learner 
resulting from C&HE^ ^ 

4. what factors affect C&HE curriculum decisions. ' % 

5. factors that Influence, learners such as teaching style, teaching 
techniques and othfers. 

Additional research is underway that is^^signed to assess aspects of 

effectiveness of C&HE. . Several state-wide studies have been initiated. 



The Ad Hoc Research Committee of the Home Economics Division of the 

American Vocational Association has initiated a national study to determine 

' / ' 

who IS enrolled in C&HE and in what specific courses they are enrolled. 
This study is beihg identified as the Census Study. This "Ad Hoc Com- 
mittee is responsible for encouraging other research projects that are 
underway. 

Even with the apparent, increase in evaluation research in C&HE, few 
national studies are underway. National studies are needed that compare 
program, differences, and similarities and assess the differences in effec- 
tiveness and the reasons for effectiveness where it is 'found. Federal 

• ■ ' ' <^ , , 

"funding would be a real asset for encouraging the initiation and completion 
of such studies. 
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